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1. Synthesis of Search Control 
Heuristics 

One portion of my research has focused on auto- 
matic synthesis of search control heuristics for con- 
straint satisfaction problems (CSPs). I have developed 
techniques for automatically synthesizing two types of 
heuristics for CSPs: Filtering functions are used to re- 
move portions of a search space from consideration. 
Evaluation functions are used to order the remain- 
ing choices. My techniques operate by first construct- 
ing exactly correct filters and evaluators. These oper- 
ate by exhaustively searching an entire CSP problem 
space. Abstracting and decomposing transformations 
are then applied in order to make the filters and eval- 
uators easier to compute. An abstracting transforma- 
tion replaces the original CSP problem space with a 
smaller abstraction space. A decomposing transfor- 
mation splits a single CSP problem space into two 
or more subspaces, ignoring any interactions between 
them. Both types of transformation potentially intro- 
duce errors into the initially exact filters and evalua- 
tors. The transformations thus implement a tradeoff 
between the cost of using filters and evaluators, and the 
accuracy of the heuristic advice they provide. I have 
shown these techniques to be capable of synthesizing 
useful heuristics in domains such as floor-planning and 
job-scheduling, among others. (See [Ellman, 1992].) 

2. Synthesis of Hierarchic Problem 
Solving Algorithms 

Another portion of my research is focused on automatic 
synthesis of hierarchic algorithms for solving constraint 
satisfaction problems (CSPs). I have developed a tech- 
nique for constructing hierarchic problem solvers based 
on numeric interval algebra. My system takes as inputs 
a candidate solution space 5 and a constraint C on 
candidate solutions. The solution space 5 is assumed 
to be a cartesian product R n where J2 i9 a set of inte- 
gers. The constraint C is assumed to be represented in 
terms of arithmetic, relational and boolean operations. 
From these inputs the system constructs an abstract 
solution space 5 G as a cartesian product where R a 


is a set of disjoint intervals that covers JZ. The system 
also constructs an abstract constraint C a on abstract 
solutions. The abstract constraint C a is obtained from 
the original constraint C by replacing ordinary arith- 
metic operations with interval algebra operations and 
replacing boolean operations with boolean set operas 
tions. The abstract space S a and abstract constraint 
C a are then used to build a hierarchic problem solver 
that operates in two stages. The first stage finds an 
abstract solution in the space S a of intervals. The sec- 
ond stage refines the abstract solution into a concrete 
solution in the original search space S. I have shown 
this approach to be capable of synthesizing efficient 
problem solvers in domains such as floor-planning and 
job-scheduling, among others. (See [Ellman, 1992].) 

3, Decomposition in Design 
Optimization 

Another portion of my research is focused on auto- 
matic decomposition of design optimization problems. 
We are using the design of racing yacht hulls as a 
testbed domain for this research. Decomposition is 
especially important in the design of complex physi- 
cal shapes such as yacht hulls. Exhaustive optimiza- 
tion is impossible because hull shapes axe specified 
by a large number of parameters. Decomposition di- 
minishes optimization costs by partitioning the shape 
parameters into non-interacting or weakly-interacting 
sets. We have developed a combination of empiri- 
cal and knowledge-based techniques for finding use- 
ful decompositions. The knowledge-based method ex- 
amines a declarative description of the function to be 
optimized in order to identify parameters that poten- 
tially interact with each other. The empirical method 
runs computational experiments in order to determine 
which potential interactions actually do occur in prac- 
tice. We expect this approach to find decompositions 
that will result in faster optimization, with a minimal 
sacrifice in the quality of the resulting design. Imple- 
mentation and testing of this approach are currently in 
progress. (I am pursuing this research in collaboration 
with Mark Schwabacher.) (See [Ellman et a/., 1992].) 
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4. Model Selection in Design 
Optimization 

Another portion of my research is focused on intelligent 
model selection in design optimization. The model se- 
lection problem results from the difficulty of using ex- 
act models to analyze the performance of candidate 
designs. For example, in the domain of racing yacht 
design, an exact analysis of a yacht’s performance 
would require a computationally expensive solution of 
the Navier-Stokes equations. Approximate models are 
therefore needed in order diminish the costs of analyz- 
ing and evaluating candidate designs. In many situa- 
tions, more than one approximate model is available. 
For example, in the yacht design domain, the induced 
resistance of a yacht can be predicted by solving La 
Place’s equation - an approximation of Navier-Stokes 
- or by using a simple algebraic formula. The two ap- 
proximations differ widely in both the costs of com- 
putation and the accuracy of the results. Intelligent 
model selection techniques are therefore needed to de- 
termine which approximation is appropriate during a 
given phase of the design process. 

We have attacked the model selection problem in 
the context of hillclimbing optimization. We have de- 
veloped a technique which we call ” gradient magnitude 
based model selection”. This technique is based on the 
observation that a highly approximate model will of- 
ten suffice when climbing a steep slope, because the 
correct direction of change is easy to determine. On 
the other hand, a more accurate model will often be 
required when climbing a gradual incline, because the 
correct direction of change is harder to determine. Our 
technique operates by comparing the estimated error 
of an approximation to the magnitude of the local gra- 
dient of the function to be optimized. An approxima- 
tion is considered acceptable as long as the gradient 
is large enough, or the error is small enough, so that 
each proposed hillclimbing step is guaranteed to im- 
prove the value of the goal function. Implementation 
and testing of this approach are currently in progress. 

I am pursuing this research in collaboration with John 
Keane, (See [Ellman et a/., 1992].) 
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